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BACKGROUND OF THE INVENTION 



I. Field of the Invention 

10 

The present invention relates to both convolutional 
decoding and to turbo decoding for communications applications 
and in particular to mobile, point-to-point and satellite 
communication networks, CDMA (Code Division Multiple Access) and 
15 OFDMA (Orthogonal Frequency Division Multiple Access) cellular 
telephone and wireless data communications with data rates to 
multiple Tl (1.544 Mbps) and higher (>100 Mbps) , and to optical 

WDMA (Wavelength Division Multiple Access) links with data rates 

< 

to >100 GBps (Gega bit per second) and higher ranges. More 
20 specifically the present invention relates to novel a-posteriori 
probabilities and decisioning metric paradigms and architectures 
which reduce the number of arithmetic multiply operations and 
thereby reduce the computational complexity, improve iterative 
convergence thereby reducing complexity, improve bit error rate 
25 (BER) performance, and provide new metric processing algorithms 
to support the various decoding algorithms. 

II. Description of the Related Art 

30 

Current art is represented by the recent IEEE publication 
in reference [1] which summarizes the theorectical and 
applications work on turbo codes, books on turbo codes in 
references [2] , [3] , [4] , [5] , [6], [7], [8] and the reference text on 



1 



the theorectical foundations of probability and decisioning 
metrics [9]. In addition there are the fundamental patents on 
turbo decoding. 



5 Maximum likelihood ML decisioning metrics DM are currently 

used in turbo and convolutional decoding wherein DM is the 
natural logarithm of the ML probability which is the conditional 
Gaussian probability of the observed communications channel 
output symbol y assuming that the transmitted symbol is x. This 
10 defines the decisioning metric DM in equations (1) where In is 
the natural logarithm and log is the logarithm. Reference to log 
is understood to mean the natural logarithm since it is always 

15 

Decisioning metric DM (1) 

1 ML probability p(y|x) is the Gaussian conditional 

probability 

p(y|x) - exp(-|y-x| 2 /2c 2 ) / (2n) 1/2 o 

20 

2 Log of the ML 
ln[p(y|x)] = -\y-x\ 2 /2o 2 -In [ (2tt) 1/2 a] 

Decisioning metric DM is the logarithm of the ML 
probability with the additive constant term removed 

DM(y,x) » -|y-x| 2 /2a 2 
wherein the constant l/2a 2 scales the DM relative 
to the noise floor 2a 2 of the symbol detector 

30 

used in turbo decoding and in convolutional decoding. Step 1 is 
the definition of the zero-mean conditional Gaussian probability 
density function. Step 2 is the log. Step 3 is the decisioning 
metric DM that measures the distance between y and x, where a is 



25 
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the one sigma value of the inphase and the quadrature noise. This 
DM metric is used in the convolutional decoding algorithm, and in 
the turbo decoding algorithm when combined with the a-priori 
probability of the correct decoding bit. The DM metric is a ML 
5 distance metric and the functional form is determined by the 
zero-mean Gaussian assumption for the link and receiver 
processing noise. 

Maximum a-posteriori probability MAP turbo decoding starts 
10 with a sequence of observed channel output symbols {y(k), 
k=l,2,...,N} of the receiver where k is the running index over the 
N transmitted symbols. 

FIG. 1 is a representative turbo encoder block diagram for 
15 a parallel architecture. Input 1 to the encoder are the user data 
bits {d(k)} for k=l,2,. . .,N. The encoder for a turbo code uses 
a recursive systematic code RSC which means the first codeword 
bit 2 is -the user data bit called systematic bit, or bits, which 
are uncoded. These user data bits {d(k)} are also handed over 
20 to the first RSC encoder 3 called #1 encoder, and after 
interleaving 4 are also handed over to the second RSC encoder 5 
called #2 encoder. User data bits and the encoder output bits 
are punctured 6 to obtain the correct code rate and then 
multiplexed into a continuous output bit stream 7 of codewords 

25 {c(k)} for each of the codeword clocks k=l,2, ,N. Each 

codeword c(k) is a set of bits consisting of the systematic bits, 
#1 encoder output bits, and #2 encoder output bits. 

FIG. 2 is a representative transmitter block diagram for 
30 implementation of both the turbo encoder in FIG. 1 and the 
convolutional encoder in FIG. 7. Signal processing starts with 
the input stream {d(k)} of user data bits 8 to the 
convolutional/turbo encoder 9. Output 10 of the 
convolutional/turbo encoder in FIG. 1 are the stream of codewords 
35 {c(k)} handed over to the frame processor. Frame processor 11 
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accepts these codewords and performs error detecting coding such 
as a CRC (cyclic redundant code) and frame formatting, and 
passes the outputs to the symbol encoder 12 which encodes the 
data onto amplitude and phase with possible frequency and time 

.5 assignments and whose outputs are the transmitter symbols {x(k)} 
corresponding to the codewords of the convolutional /turbo encoder 
output as well as the other symbols for the frame data including 
the CRC. Framing can be done before and/or after the ' turbo 
encoding. Transmitter symbols {x(k)} are modulated 13 into a 

10 waveform. Modulator output signals for multiple channels are 
multiple-access processed and combined 14 for handover 14 as a 
stream of complex baseband digital signal samples {z(ti)} where ti 
is a time index, to the digital-to-analog conversion processing 

15 which converts the complex baseband input signal from the 
15 multiple access processing into a single sideband SSB upconverted 

real signal v(t) 15 at an intermediate frequency IF where 
{z(ti)} is the stream of complex baseband signal input samples 
at the digital times {tj.} to the digital-to-analog conversion. 
The digital-to-analog processing also includes beam forming 

20 calculations for both digital and analog beam-forming antennas. 
Multiple access examples in 14 are time division multiple 
access TDMA, frequency division FDMA, code division CDMA, space 
division SDMA, frequency hop multiple access FHMA, and all 
combinations of these and others not mentioned but inferred from 

25 this representative list. 

For multiple beam antennas 16 in FIG. 2 the beam 
coefficients for each beam element for each complex digital 
sample are processed 15 and the individual digital streams are 
30 handed off to the corresponding antenna elements where they are 
SSB upconverted to an IF and processed by the analog front end 

16 at each element and the array of elements form the beams and 
within each beam the transmitted signal is similar to the real RF 
signal v(t) in 17 for a single beam. For single beams the 

35 analog front end 16 upconverts and amplifies this IF signal and 



transmits it as the real RF signal v(t) 17. This real waveform 
v(t) 17 is at the RF carrier frequency f 0 and is the real part 
of the complex envelope of the baseband waveform z(t) multiplied 
by the RF carrier with the phase angle <|> which accounts for the 
5 phase change from the baseband signal to the transmitted signal, 

MAP (maximum a-posteriori probability) joint probability 
used in the MAP turbo decoding algorithm is defined in equations 
(2) which are taken from references [1],[2]. Definition 1 
10 introduces common terminology in 



MAP joint probability for turbo decoding 



(2) 



1 Definitions 



15 



S(k) 



Decoder trellis state at clock k 



Decoder shift register state at clock k 



= Index of received codewords 



= trellis decoder states 



20 



= decoding clock 
s f ,s = Values of S(k-l), S(k) respectively 
y = Set of observed channel output symbols 



- {y(k), k=l,2,...,N} 
RSC = Recursive systematic code 



25 



= Systematic code SC with feedback which is a 
requirement for turbo decoding 



Parallel encoding = Encoding configuration for turbo 



decoding which transmits the symbols using a 
parallel architecture, which is the assumed 
architecture for this invention disclosure 



30 



y(k) = Output symbols for codeword/clock k 
{y(j<k)} = Output symbols for clocks j=l, 2, k~l 
{y(j>k)} = Output symbols for clocks j=k+l, ,2,...,N 
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2 Decoding states and observations 

Observations are the set {y ( k) , k=l , 2 , N) 



» „ 



5 1 k - 1, 2,...,N N 

Subsets y ( j<k) ,y (k) ,y ( j>k) of y are of interest 

7--»| | | 1— -»| 

k-1 k k+1 \ N 

10 y(j<k) y(k). y(j>k) 



Decoder trellis states of interest are s',s 

I | I—— -»| 

15 k-1 k k+1 N 

t V 

S(k-l)=s' S(k)=s 



20. 3 MAP joint probability 

The joint probability of interest for MAP is 
p(s',s,y) =p(s',s, y(j<k) ,y(k) ,y(j>k) ) " 

25 turbo decoding literature. In 2 the decoding states s',s are 

defined at clocks k-l,k and the observations are defined over the 
j=l, 2, k-1 as y(j<k), over j=k+l / ...,N as y(j>k) # and at k as 
y(k) . In 3 the MAP joint probability is defined as a function of 
these decoder states and observations. 

30 

Recursive equation for the MAP joint probability is derived 
in equations (3) by reformulating the joint probability equation 
in 3 in equations (2) as a function of the recursive state 
estimators a,p and the state transition probability y. Step 1 
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is the application of Bayes rule to partition the joint 
probability. Step 2 takes advantage of. the assumption that the 



5 Recursive formulation of MAP joint probability (3) 

1 Bayes theorem or rule p (a,b) =p (a|b)p (b) can be used to 
rewrite the MAP joint probability in 3 in equation (2) 

p(s',s,y) = p(s',s, y (j<k) ,y (k) ,y(j>k) 

= P(y(j>k) |s',s, y(j<k),y(k)) 
10 *p(s',s, y(j<k),y(k))) 

where is a multiply operation 

2 Assuming the channel is memoryless 

p(s',s,y) = p(y(j>k)|s) p(s',s, y(j<k),y(k)) 

15 

3 Re-applying Bayes rule and the assumption that 
the channel is memoryless 

P(s',s,y) -p(y(j>k)|s) p(s,y(k)|s') p(s',y(j<k)) 

20 4 This equation can be rewritten as a function of the 

recursive estimators and state transition probability 

p(s,s',y)= p k (s) y k (s,s') a k -i(s') 
where by definition 

ftc(s) =p(y(j>k)|s) 
25 Yk(s r s r ) - p(s,y(k) Is') 

a k -i(s' ) = p(s' ,y(j<k) ) 



channel is memoryless to simplify the partitioning in step 1. 
30 Step 3 re-applies the Bayes rule and the memoryless assumption to 
re-partition the equation and simplify it to the final form used 
in the MAP algorithm. Step 4 transforms the joint probability in 
step 3 derived as a product of three probabilities, into the 
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equivalent product of the two estimators a k -i(s') ,pk(s) and the 
state transition probability y k (s, s' ) for the MAP algorithm. 

Forward recursive equation' for the state estimator a k (s) is 
5 derived in equations (4) as a forward recursion which is a 
function of y k (s,s') and the previous estimate a k -i(s')- Step 1 
starts with the definition of <x k (s) which is derived from the 
equation for a k _i(s') in 4 in equations (3) . Step 2 introduces 
the state s' by observing that the probability summed over all 
10 values of s' is equal to the probability with s' excluded. Step 3 
applies Bayes rule to partition the probabilities. In step 4 the 
assumption that the channel is memoryless enables the equation to 
be simplified to the form used 



15 



Forward recursive equation for <x k (s) 



(4) 



1 



Definition of a k _i(s') in 4 in equations (3) gives 



a k (s) = p(s,y (j<k) ,y(k) ) 



20 



2 



This probability can be written as the sum of 
joint probabilities over all possible states of s' 
ot k (s) = Zaii s' p(s,s' ,y (j<k) ,y (k) ) 



25 



3 



Applying Bayes rule 

a k (s) = San s' p(s,y(k) I s' ,y (j<k) )p (s' ,y (j<k) ) 



4 



Applying the channel memoryless assumption 
a k (s) = Zaii s' p(s,y (k) |s' )p(s' ,y (j<k) ) 



30 



5 



Substituting the definitions of y k (s,s') and 



a k -i(s') from 4 in equations (3) 



a k (s) = Zaii s' Yk(s # s r ) a^i(s' ) 
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in the MAP algorithm. In step 5, substitution of y k (s,s') and 
ajc-i(s') from 4 in equations (3) gives the final form for the 
recursive equation for a k (s) . 

Backward recursive equation for the state estimator p k -i(s') 
is derived as a backward recursion in equations (5) as a 
function of the Yk(s,s') and the previous estimate p k (s), 
following the steps in equations (4). Step 1 derives pk-i(s') 
from the equation for p k (s) in 4 in equations (3). Step 2 
follows steps 2,3,4 in the derivation of a k (s) in equations (4). 

Backward recursion equation for p k -i(s') (5) 

1 The definition for p k (s) from 4 in equations (3) 

p k -i(s') = p(y(j>k-l) Is') 

2 Following steps similar to steps 2,3,4 in equations (4) 

Pk-i(s') = Zan s P(y(j>k) |s)p(s,y(k) Is') 

3 Substituting the definitions of y k (s,s') and 
p k (s) from 4 in equations (3) 

Pk-i(s') = Sau s Pk(s) y k (s,s') 

In step 3, . substitution y k (s,s') and p k (s) from 4 in equations 
(3) gives the final form for the recursive equation for p k -i(s'). 

State transition probability y k (s,s') and the log,- y k (s,s') 
of y k (s,s') are derived in equations (6). The y k (s,s') is the 
probability of 



State transition probabilities y k (s, s' ) ,^[3, s' ) (6) 

1 From the definition of y*{s,s') from 4 in 

equations (3) and Bayes rule 
5 Yx(s,s') = p(s,y(k) Is') 

= p(y(k) |s,s') p(sls') 

2 Define 

d(k) = input bit necessary to cause the 
10 transition from state S(k-l)=s' to S(k)=s 

p(d(k)) = a-priori probability of d(k) 
x(k) = transmitted codeword symbols defines the 
transition from S(k-l)=s' to S(k)=s 
= {x(k,b)) where b refers to the codeword bit 
15 y(k) = received codeword symbols for 

codeword/clock k 
= (y(k,b)} where b refers to the codeword bit 

3 With these definitions and the memoryless assumption, 
20 the Yk(s,s') equation in 1 becomes 

y k (s,s') - p(y(k) |s,s') p(d(k)) 
= p(y(k) |x(k)) p(d(k)) 
= lib P(y(k,b) |x(k f b)) p(d(k)) 

25 4 Assume the channel is Gaussian and the symbols are BPSK 

' y k (s,s')= lib exp( -|y(k,b)-x(k,b) 1 2 /2a 2 ) / (2tc) 1/2 a 

* P(d(k)) 

5 The DM from 3 in equations (1) can be rewritten 
30 DM(s|s')= Z b DM(y(k,b) ^(k.b) ) 

= S b -|y(k,b)-x(k,b) | 2 /2a 2 
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6 Log equation for x k (s,s') takes the log, 
uses DM, and deletes the additive constant 

jMs,s') = DM(sls') + £(d(k)) 
wherein £(d(k) )=log(p(d(k) ) ) 

5 

the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s symbolically written as s'->s. Step 1 applies Bayes 
rule to the definition of Yk(s,s') in 4 in equations (3). Step 2 

10 are definitions. Step 3 uses these definitions to transform the 
y k (s,s') into the product of the conditional probabilities 
p (y (k) | x (k) ) of the received codeword symbols {y(k)} given the 
transmitted codeword symbols *{x(k)}, and the a-priori probability 
p{d(k)) causing this transition. The p(y(k)|x(k)) is the product 

15 over the bits b-1,2,... for the #1 or #2 encoders in FIG. 1 
depending on which is being addressed, of the probabilities for 
each bit p (y (x,b) I x (k,b) ) . 

Step 4 introduces the standard turbo code assumption that 
20 the channel is Gaussian and uses BPSK (Binary phase shift 
keying) symbols which means d(k)=+/-l when interpreted as a BPSK 
symbol, and a is the one sigma Gaussian inphase and quadrature 
noise. Step 5 observes that the DM metric is a function of the 
states s,s' which is equal to the sum of the DM metrics over the 
25 bits {b} of the codeword corresponding to the transition from 
S(k-l)=s' to S(k)= s. In step 6 the equation for the log, 

Xk(s,s'), of Yk(s,s') as a function of the DM metric and the log, 
£(d(k)), of p(d(k)) is used in turbo decoding algorithms, and in 
co.nvolutional decoding algorithms when £(d(k)) is deleted. 

30 

Log equations for Ok(s), J3 k -i(s') are derived in equations 
(7) from equations (4) , (5) respectively for <x k (s), Pk-i(s') 
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using the definition of y k ( s / s ') in 6 in equations (6). Step i 
gives the log equation for a k (s) by taking the 

Log equations for a k (s), fik-i(s') (7) 

1 Log, a k (s) , of a k (s) 

a k (s) = ln[Ln s' exp(a k , 1 (s')+DM(s|s') + £(d(k))] 

2 Log, &-i(s'), of p k -i(s') 

fik-i(s')- ln[ Zaiisexp ( g k (s)+DM(s|s') + £(d(k))] 

log of the <x k (s) equation in 5 in equations (4) and using the 
definition of x k (s,s') in 6 in equations (6). Step 2 takes the 
log of the equation for p k -i(s') in 3 in equations (5) to derive 
the log equation for J3 k -i(s') and uses the same definition for 
Ik(s,s # ) . 

MAP equations for the log likelihood ratio L(d(k)|y)) are 
derived in equations (8) . Step 1 is the definiton from references 
[1],[2]. Step 2 uses the Bayes rule P (a,b) =P.(a |b) P (b) with the 
p(y) cancelled in the division. Step 3 replaces p(d(k)) with the 

MAP equations (8) 

1 Definition 

L(d(k) ) |y) = ln[ p(d(k)=+l|y) ] 
-ln[ p(d(k)=-l|y) ] 

2 Bayes rule allows this to be rewritten 

L(d(k) ) |y) = ln[ p (d (k) =+l,y) ] 
-ln[ p(d(k)— l,y) ] 
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3 Probability of p(d(k)) is the sum of the probabilities 
that the state S (k-1) =s' . transitions to S(k)=s for the 
assumed values d(k)=+l and d(k)=-l 

L(d(k))|y) = ln[ E (3 ,s' id(k)- + i) p(s,s',y)] 
-ln[ 2 {SrS 'id{k)=-i) P(s,s',y) ] 



4 MAP equation is obtained by substituting the 
a k -i(s' ) ,g k (s) , 3k(s,s') into 3 
10 L(d(k))|y) = ln[ E (s ,s' id(k>- + u p(s,s\y)] 

-ln[ Z (s#S 'ici(k)-i) P(s,s' ,y) ] 

= ln[E (s ,sMd(k)« + i) expfctk-ifs' )+DM(s|s' )+£(d(k) )+fik(s) ) ] 
-ln[£ (s , sMd(k) -i) exp(a k - 1 (s' )+DM(s|s / )+£(d(k) )+fik(s) ) ] 
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5 Decide d(k) = +1 when L(d(k)|y) 2: 0 
= -1 when L(d(k) |y) < 0 



20 

equivalent sum of the probabilities that the transition from 
S(k-l)=s' to S(k)=s occurs for d(k)=+l and for d(k)=-L Step 4 
substitutes the log of the recursive estimators <x k -i (s' ) /j3 k (s) , 
from 1,2 in equations (7) and the state transition probability 
25 y k (s,s f ) from 6 in equations (6). In step 5 the hard decisioning 
rule is d(k)= +/-1 iff L(d(k)|y) >/< 0 and the soft decisioning 
metric is the value of L(d(k)|y). 

MAP turbo decoding iterative algorithm is defined in FIG. 3 
30 and in equations (9) for a parallel architecture using the MAP a- 
posteriori equation in equations (8) with BPSK (Binary Phase 
Shift Keying) modulation. This basic algorithm is used to 
illustrate how the decisioning metric DM is implemented, and is 
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representative of how the DM metric is used for the more 
efficient algorithms such as the Log-MAP, Max-Log-MAP, iterative 
SOVA , and others, for parallel and serial architectures and 
other variations, and for modulations other than BPSK. 

5 

FIG. 3 inputs are the detected soft output symbols 18 from 
the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
{y(k,b=l)} for the systematic bit b=l which is the uncoded bit, 

10 the subset of the output symbols from #1 encoder 3 in FIG. 1, and 
the remaining output symbols from #2 encoder 5 in FIG. 1. 
Systematic bits are routed to both #1 decoder 22 and #2 decoder 
25. Encoded bits from #1 and #2 encoders are separately routed 19 
to #1 and #2 decoders. The detailed decoding in . FIG. 3 will be 

15 described in parallel with the MAP turbo decoding iterative 
algorithm in equations (9) . In equations (9) , step 1 defines the 
various parameters used in the turbo decoding iterations. 

Step 2 starts iteration i=l in FIG. 3 for #1 decoder 22. 

20 Extrinsic information L ie from this decoder 22 in FIG. 3 for i=l 
is calculated in step 2 in equations (9) using the soft outputs 
{y(k,b=l)} 20 of the received channel for the systematic bit b=l 
which is the uncoded bit, the subset of the detected output 
symbols 19 which are from #1 decoder 3 in FIG. 1, and the #1 

25 decoder likelihood ratio output Li calculated from 4 in equations 
8. The a-priori information on p(d(k)) in 4 in equations (8) 
from #2 decoder 25 is not available so j>(d(k))=0 corresponding 
to p(d(k)=+l)=p(d(k)=-l)= 

30 

MAP turbo decoding iterative algorithm (9) 
Step 1 Definitions 

L m = { L(d(k)|y)), k=l,2,....} for m=#l,#2 decoders 
= a-posteriori likelihood ratio 
35 L me = { L me (d(k) |y)), k=l,2,....} 
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= extrinsic information from m=#l,#2 decoder 
= a-priori estimates of In [p (d=+l) /p (d=-l) ] 

which defines £ for the other decoder using 

equations (10) to solve for £ 

L le = Interleaved L ie 

, L 2 = De-interleaved L 2e / L 2 
y(k,b=l) = y for uncoded bit b=l 

y (k,b=l) = interleaved y for uncoded bit b=l 

Step 2 Iteration i=l starts the turbo decoding 
Lie - Li - 0 - (2/a 2 )Re[y (k,b=l) ] 
L 2e = L 2 - L lc - (2/a 2 )Re[y (k,b=l)] 
where Re (o) = Real(o) 

Step 3 For iteration i=2,3,... 

L le - Li - Lj, - (2/a 2 )Re[y(k,b=l)] 

L 2e = L 2 - L lc - (2/a 2 )Re[y (k,b=l) } 
Step 4 Decode after last iteration 
Decide d(k)=+l/-l ■ 1/0 bit value 
for L 2 (d(k) |y)>/<0 for k=l,2,. . . 

where d (k) is the estimate of d(k) from turbo 
decoding 

Step 2 next proceeds to #2 decoder 25. A-priori estimates 
for £(d(k)) are calculated from the extrinsic information from #1 
decoder after interleaving 23 in FIG. 3 in order to align the 
bits with the interleaved bits 4 in FIG. 1 which are encoded by 
the #2 encoder 5. Calculation of the a-priori £ for #1,#2 



decoder using the extrinsic information from #2,#1 decoder is 
given in equations (10) from references [2], [4]. Inputs to the 

5 A-priori calculation of £ in 4 in equations 8 (10) 

K = [1+ exp(L me )] 
£(d(k)= -1) = -ln(K) 

£(d(k) = +1) = L^-lntK) 

10 

#2 decoder 25 in FIG. 3 are the detected output symbols 19 from 
the #2 encoder 5 in FIG, 1, the detected symbols for the 
systematic bits 21 after interleaving 24, and the extrinsic 
information from #1 decoder 22 after interleaving 23. 
15 Calculation of the extrinsic information L 2e from #2 decoder is 
given in step 2 in equations (9) . 

Step 3 repeats step 2 with the subtraction of the de- 
interleaved 26 extrinsic information input to #1 decoder 22 

20 from #2 decoder 25. This is used to calculate the a-priori 

probabilities £ using equations (10) for use in the evaluation of 
the a-posterior likelihood ratio L x from decoder #1 7 and also 
used in the calculation of the extrinsic information L ie for 
decoder #1 in step 3 in equations (9) . 

25 

Step 4 is the calculation of the estimates {d(k)} for the 
transmitted information {d(k)} in the form of + /-1 used in the 
iterative algorithm to model the BPSK modulation with values +/-1 

A 

for the estimated input signal {d(k)} in 28 with +1 
30 corresponding to the bit value 1 and -1 for the bit value 0. The 

de-interleaved 27 a-posteriori maximum likelihood ratio L 2 from 
#2 decoder in FIG. 3 yields these output bits 28 using the hard 
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decisioning rule that decides 1/0 depending on whether the L 2 is 
>0 or <0, 

Convolutional decoding will be discussed in the disclosure 
5 of the new invention. 

FIG. 4 is a representative demodulation receiver block 
diagram for implementation of the turbo decoder in FIG. 3 and the 
convolutional decoder in FIG. 8, which emphasizes the 

10 demodulation processing for both single and multiple channels. 
The signal processing starts with the user transmitted wavefronts 
29 incident at the receiver antenna for the n u users u =1,..., n u < 
N c . These wavefronts are combined by addition in the antenna to 
form the receive Rx signal v(t) at the antenna output 30 where 

15 v(t) is an estimate of the transmitted signal v(t) 17 in FIG. 
2, that is received with errors in time At, frequency Af, phase 
A8, and with an estimate z(t) of the transmitted, complex baseband 

signal z(t) 14 in FIG. 2. This received signal v(t) is 
amplified and downconverted by the analog front end 31 and then 
20 synchronized and analog-to-digital ADC converted 32. Outputs 
from the ADC are handed over to the multiple access channel 
recovery signal processing 33 and the demodulation processing 
34 where the waveform is removed to recover the symbols 35. These 
detected symbols 35 are turbo/convolutional decoded 36 to 

25 recover estimates { d(k) } of the received data which are processed 
by the frame processor 37 to recover estimates 38 of the 
transmitted user data words. The serial processing for the 
multiple access channel recovery and the demodulator is combined 
for several of the multiple access schemes and for the 

30 demodulation such as GMSK. As noted in the discussion for FIG. 2, 
the frame processing can be before and/or after the turbo 
decoder. 
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It should be obvious to anyone skilled in the 
communications art that this example implementation clearly 
defines the fundamental current turbo and convolutional encoding 
and decoding signal processing relevant to this invention 
5 disclosure and it is obvious that this example is representative 
of the other possible signal processing approaches. 

For cellular applications the transmitter description 
describes the turbo and convolutional encoding transmission 
10 signal processing applicable to this invention for both the hub 
and user terminals, and the receiver describes the corresponding 
turbo and convolutional decoding receiving signal processing for 
the hub and user terminals for applicability to this invention. 

15 For optical communications applications the microwave 

processing at the front end of both the transmitter and the 
receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
transmitter and which performs the optical laser receiving 

20 function of the microwave processing to recover the complex 
baseband received signal with the remainder of the signal 
processing functionally the same as described in FIG. 2 for the 
turbo and convolutional encoding transmitter and in FIG. 4 for 
the turbo and convolutional decoding receiver. • 

25 

SUMMARY OF INVENTION 

30 This invention introduces a new decisioning metrics in this 

invention for turbo decoding and convolutional decoding, a new 
MAP joint probability for turbo decoding, a new formulation to 
replace the ML probability for convolutional decoding, and the 
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corresponding new estimators that replace the current recursive 
estimators a k -i,Pk, and the new replacement for the state 
transition probability y k used for both convolutional and turbo 
decoding. It will be apparent to the reader that these 

5 probability equations together with the decisioning metrics 
provide new mathematical framework for the decoding algorithms, 
and offer an improvement in BER performance, rate of convergence 
for turbo decoding, and lower implementation complexities. 

10 The MAP joint probability for turbo decoding is p(s,s',y) 

defined in 3 in equations (2), where s,s' are the decoding 
states for symbol sets k,k-l respectively and y is the complete 
set of observed symbol sets for k=l,2,... ,N. The current 
practice uses the p(s,s',y) in the MAP equations (8) wherein the 

15 MAP a-posteriori log likelihood ratio L(d(k) |y) in 3 in equations • 
(8) reduces to the natural log of the ratio of the sum of 
p(s,s',y) over s,s' for d(k)=+l, to the sum of p(s,s',y) over 
s,s' for d(k)=-l. 

20 The MAP joint probability p(s,s , ,y) was formulated to 

support the use of the maximum likelihood ML probability p(y|x) 
in 1 in equations (1) and the corresponding log form of the ML 
decisioning metric DM in 3 in equations (1) , and to support the 
factoring into the product of the estimators <x k -i,(3k/Yk in 4 in 

25 equations (3) . This factoring in log form in 4 in equations (8) 
is equal to the sum of the log forms of these estimators a k - 
i/fik/Yk which are used for all of the turbo decoding algorithms, 
as well as for the covolutional decoding algorithms upon deleting 
the a-priori £ in y k in 6 in equations (6) . 

30 

ML maximizes p(y|x) with respect to x in order to find the 
best x which is equivalent to maximizing the decisioning metric 
DM in 3 in. equations (1) equal to DM=- 1 y-x 1 2 /2cr 2 with respect to x 
where |y-x| is the geometric distance between x and y. This DM in 
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3 in equations (1) is the natural log of p(y|x) with the additive 
constant removed. Maximizing DM is equivalent to minimizing |y-x| 
and therefore selects the x which is closest to y as the ML 
choice for x. ML decisioning metric DM is used to make the bit 
5 decisions in turbo decoding as demonstrated in equations 
(7) , (8) , (9) , and is used to select the best trellis paths in 
convolutional decoding as will be demonstrated in the disclosure 
of this invention. 

10 The new MAP probability p(s,s'|y) is the a-posteriori 

probability of s,s' given the observations y. This is the 
correct formulation for the MAP probability from a probability 
theorectic viewpoint Ref. [8], and is made possible by the use 
of the a-posteriori probability p(x|y) for the probability of the 

15 transmitted symbol x given the observed symbol y, in place of 
the ML p(y|x) in equations (1). It will be demonstrated that by 
using the new MX decisioning metric DX, the p(s,s'|y) in log 
form can be factored into the sum of the new recursive estimators 
which replace the a k -i,J3 k and the new state transition probability 

20 £ k that replaces x k currently used for all of the turbo decoding 
algorithms, 

The new maximum a-posteriori algorithm MX replaces the 
maximum likelihood algorithm ML, and maximizes the a-posteriori 

25 probability p(x | y) of x conditioned on the observation y, with 
respect to the selection of x. Maximizing p(x|y) is equivalent 
to maximizing the natural log of p(x|y) and yields the new 
decisioning metric DX=Re (yx* ) /a 2 - | x 1 2 /2a 2 +£ (x) wherein p(x) is the 
natural log of p(x), Re(o) is the real part of (o) , and x* is the 

30 complex conjugate of x. MX and its decisioning metric DX select 
the x which is closest to y as the MX choice for x. In the 
disclosure of this invention it will be demonstrated that the MX 
decisioning metric DX can be used to make the bit decisions in 
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turbo decoding and can be used to select the best trellis paths 
in convolutional decoding. 

Without any mathematical analysis, it should be apparent 
5 that DX has less noise compared to DM since DX is linear in y 
whereas DM involves the square of the vector y. This lower 
noise level translates into an improved decisioning performance 
of DX compared to DM. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 
AND THE PERFORMANCE DATA 

15 The above-mentioned and other features, objects, design 

algorithms, and performance advantages of the present invention 
will become more apparent from the detailed description set forth 
below when taken in conjunction with the drawings wherein like 
reference characters and numerals denote like elements, and in 

20 which: 

FIG. 1 is a representative block diagram of the 
implementation of a turbo encoder using a parallel architecture. 

25 FIG. 2 is a representative implementation block diagram 

for the turbo encoder and the convolutional encoder transmitter. 

FIG. 3 is a representative block diagram of the 
implementation of a turbo decoder using a parallel architecture. 

30 

FIG. 4 is a representative implementation block diagram 
for the turbo decoder and convolutional decoder receiver. 
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FIG. 5 plots the Monte Carlo simulation of the decisioning 
metric performance for the MX decisioning metric DX=ln [p (x | y) ] 
and the ML decisioning metric DM=ln[p (y|x) ] against the symbol y 
signal-to-noise power ratio S/N. 

5 

FIG. 6 plots the improvement in S/N against the symbol y S/N 
which improvement is the advantage in S/N from using the MX 
decisioning metric. 

10 FIG. 7 is a representative block diagram of a convolutional 

encoder. 

FIG. 8 is a representative block diagram of a convolutional 
decoder. 

15 

DISCLOSURE OF THE INVENTION 

20 The invention provides new decisioning metrics and new 

probabilities and new equations for the turbo decoding and 
convolutional decoding, which together provide performance 
improvements and reduce the decoder implementation complexities 
for all decoding architectures. In this invention disclosure, the 

25 new decisioning metric will be derived and evaluated prior to the 
derivation of the new probability equations and algorithm 
examples for the new decoding architectures for turbo and 
convolutional codes. 

30. The MX a-posteriori probability p(x|y) defines the 

decisioning metric DX for turbo and convolutional decodingwherein 
the DX is derived from the MX in equations (11) . Step 1 uses the 
Bayes rule to derive MX p(x|y) 
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MX decisioning metric DX 

1 Bayes rule p (a,b) =p (a | b) p (b) =p (b | a) p (a) 

enables MX probability p(x|y) to be defined 



(11) 



p(x|y) = p(y|x)p(x) /p(y) 

2 ML probability p(y|x) is 

10 P(y|x) - ( {2n) l/2 c)' 1 exp(-|y-x| 2 /2a 2 ) 

3 Gaussian probability p(y) is 

P(y) = ( (2ti) 1/2 a)" 1 exp(-|y| 2 /2a 2 ) 

15 

4, Equations 2,3 yield the result for MX 

p(x|y) = p(x) exp(Re (yx*)/o 2 -|x| 2 /2a 2 ) / {2n) 1/2 a 

20 5 Taking the natural log 

yields DX 

DX = ln[ p(x|y) ] 

- Re(yx*)/a 2 -tx| 2 /2a 2 + £(x) 
25 - Re(yx*) /a 2 -|x| 2 /2a 2 + £(d) 

wherein 

x* = complex conjugate of x 
p(d) = p(x) since the symbol d 
corresponds to x 
30 £(d) = ln[p(d)] 



from the ML p(y|x) and the p(y), p(x). Step 2 is the the ML 
p(y|x) as in 1 in equations (1). Step 3 defines p(y) as the 
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Gaussian probability function. Step 4 derives the MX p(x|y) 
using the p(y|x) in 2 and dividing by the p(y) in 3. Step 5 
takes the natural log of the MX a-posteriori probability in step 
4 to derive the DX and wherein the a-priori probability p(d) of 
5 data word d is equal to the a-priori p(x) of the corresponding 
data symbol since x amplitude and phase encodes d. 

FIG. 5 plots the Monte Carlo simulation decisioning 
performance 39 of the MX decisioning metric DX=ln[p (x| y) ] 41 and 

10 the ML decisioning matric DM=ln [p (y I x) ] 42 against the symbol y 
signal-to-noise power ratio S/N 40. . Equation DM=ln(p{y|x) ] 
assumes the additive constant is deleted. Decisioning metric 
performance 39 in the log domain is the difference between the 
correct and incorrect BPSK assumption for x. For the MX DX, the 

15 simulated performance metric is equal to In [<p (x | y) >/<p (x' | y) >] 
where <(o)> is the Monte Carlo statistical average over 100K 
trials of (o) , the p(x|y) is the correct decision for BPSK 
modulation, and p(x'|y) is the incorrect decision. A-priori 
probabilities of x,x' are equal which means p (x) =p (x' ) =1/2 so 

20 that the p(x)=p(x') cancels out in the DX metric. The 
performance metric for the ML DM is the same 

ln[<p(y|x}/p(y|x' )>. It is apparent from the data 41,42 that the 
required S/N to support a given level for the DX metric is 
considerably less than required for the DM metric. This directly 

25 translates into an improved BER performance. 

FIG. 6 plots the improvement in S/N 43 against the symbol y 
S/N 44 This improvement 45 in S/N from using the MX 
decisioning metric in FIG. 5 compared to the current ML, is the 
30 increase in S/N required for the ML metric to equal the value 
measured for the MX metric. Over the range of S/N of interest 
which is 0 to 10 dB, there is a -1.7 dB improvement in S/N which 
is significant and clearly translates into an improvement in BER. 



24 



There are no other available means to offer this improvement for 
both turbo and convolutional decoding. 

The new a-posteriori probability density p(s,s'|y) for MAP 
5 is written as a function of the independent observations {y(j<k), 
y(k), y(j>k)} in equations (12) using 1,2 in equations (2). 



Recursive equation for p (s, s' | y) is derived in equations 
(13) following the steps in equations (3) for the p(s,s',y) 
15 recursive equations. Step 1 is the application of Bayes rule to 
partition the probability p(s,s'|y). Step 2 takes advantage of 



New MAP a-posteriori probability 



(12) 



10 



P(s,s'|y) =p(s,s'| y(j<k), y(k) y(j>k) ) 



the assumption that the channel is memoryless to simplify the 
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Recursive formulation of p(s,s' |y) 
1 Bayes rule p (a,b) =p (a | b) p (b) can be used to 
rewrite the p(s,s'|y) in equation (12) 

p(s,s'|y) = P(s /S '| y(j<k) ,y(k) ,y(j>k) ) 
= p(s|s',y(j<k),y(k),y(j>k)) 
*p(s' ly(j<k),y(k),y(j>k)) 
where is a multiply operation 



(13) 
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2 



Assuming the channel is memoryless 

P(s,s'|y) - p(s|s',y(k),y(j>k)) p(s'|y(j<k) 



30 



3 



The events {s' , y (k) } , {y ( j>k) } are independent 
since the channel is memoryless so 2 can be 



factored 



P(s,s' |y)=p(s|s',y(k) )p(s|y(j>k))p(s' ly(j<k) ) 



35 
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4 This equation can be rewritten as a function of the 
a-posteriori recursive estimators and a-posteriori 
state transition probability 

p(s,s' , y)= p k (s|s' ) b k (s) a k -i(s') 

5 

wherein by definition 

Pk(sls') = p(s|s',y(k)) 
b k (s) = p(s|y(j>k) ) 
a k -i(s') = p(s' |y(j<k) ) 

10 

partitioning in step 1. Step 3 applies the identity 

p(a|b,c)=p(a|b)p(a|c) which is true when events b,c are 
independent p (b, c) =p (b)p (c) , to re-partition the first factor 

15 into the product of two factors. Step 4 transforms the joint 
probability in step 3 derived as a product of three 
probabilities, into the equivalent product of the two new state 
estimators a k _i (s' ) ,b k (s) and the state transition probability 
p k (s|s f ) for the new MAP turbo decoding algorithm. The p k (s|s') 

20 calculates p(s|s',y(k)) for each state transition assumption 
s->s' for symbol set k. 

These a-posteriori estimators a k (s), b k (s), p k (s|s'), are 
part of this invention disclosure and are clearly distinct from 
25 the current set of ML estimators a k i (s' ) ,p k (s) , Yk(s,s') in 4 in 
equations (3) . 

Forward recursive equation for a k (s) is derived in equations 
(14) as a forward recursion which is a function of the p k .(s|s') 
30 and the previous state estimate a k -i(s'). Step 1 starts with the 
definition of a k (s) which is derived from the equation for 
ak-i(s') in 4 in equations (13). Step 2 introduces the state s' by 
observing the probability summed over all values of s' is equal 
to the probability with s' excluded. Step 3 applies Bayes rule to 
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partition the probabilities. In step 4 the assumption that the 
channel is memoryless enables the equation to be simplified to 
the form used in the MAP algorithm. In step 5, 
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Forward recursive equation for a k (s) (14) 

1 From the definition for a k _i(s') in 4 in equations 
(13) we find 

a k (s) ■ p(s|y(j<k) ,y(k)) 

2 This probability can be written as the sum of 
joint probabilities over all possible states of s' 

a k (s) = Zaii s' P(s, s' |y ( j<k) , y (k) ) 



15 3 Applying Bayes rule 

a k (s) = Ea lls , p(s|s',y(j<k),y(k)) p(s'|y (j<k) ,y (k) ) 

4 Applying the channel memoryless assumption 
a k (s) - Zaii s< P(s|s',y(k)) p(s'|y(j<k)) 



20 
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5 Substituting the definitions of p k (s | s' , y (k) ) and 
a k _i(s') from 4 in equations (13) 
a k (s) = Zaii s' Pk(sls') a k - x (s') 



substitution of p k (s I is' , p (k) ) and a k _i(s') from 4 in equations 
(13) gives the final form for the recursive equation for a k (s) . 

Backward recursive equation for b k -i(s') is derived as a 
30 backward recursion in equations (15) as a function of the 
p k (s' I s) =p (s' I s) and the previous estimate b k (s) , following the 
steps in equations (14). Step 1 derives b k -i(s') from the 
equation for b k (s) in 4 in equations (13). Step 2 is similar to 
steps 2,3,4 in equations (14). In step 3, using thefequality 
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5 



Backward recursion equation for b k -i(s') 
1 The definition for b k (s) from 4 in equations (13) 
bk-xfs') - p(s' |y(j>k-l) 



(15) 



2 Similar to the steps 2,3, 4 in equations (4), we find 
b k -i(s') = Za lls p(s|y(j>k))p(s' |s,y(k)) 

10 3 Substituting the definitions of b k (s) from 4 

in equations (13) 

b k -i(s') =Zaiisb k (s) Pk(s'ls) 

15 

p (s' I s, y (k) ) =p (s I s' , y (k) which is equivalent to the equality 
Pk(s'|s)= Pk(s|s f ) and substitution of p k (s|s') from 4 in 
equations (13) gives the final form for the recursive equation 
for bic-i(s'). The equality p k (s'|s) = p(s|s') simply recognizes 
20 that they are defined by the same MX equations as well as the 
same decisioning metric DX. 

Log of the state transition probabilities £ k (s|s' )=£ k (s' |s) 
are derived in equations (16). The p k (s|s') is the probability 

25 of the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s given the observation y(k). For the backward 
recursion, the p k (s'|s) is the probability of the decoder 
trellis state S(k)=s transitioning from the previous state S(k- 
l)=s' given the observation y(k) . In step 1 we rewrite the 

30 definition of p k (s|s') in 4 in equations (13) as the probability 
of the state transition s'->s given the observation y(k). Step 2 
rewrites 1 as the equivalent probability of the transmitted 
symbol x(k) corresponding to the transition s'->s. Step 3 are 
definitions similar to 2 in equations (6) . Step 4 expands the 
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equations in 2 into a product over the codeword bits for the #1 
and #2 encoders 3 and 5 respectively in FIG. 1, of the 



5 State transition probabilities p k (s|s')= Pk(s'|s) (16) 

1 The pk(s|s') is defined in 4 in equations (13) 
Pk(sls') = p(s|s',y(k)) 
= p(s'-»s|y(k) ) 

10 2 Since the transition s'->s is defined by x(k) 

Pk(sls') = p(x(k) |y(k)) 

Definitions 2 in equations (6) have the properties 

d(k) = input data corresponding to x(k) 
15 p(d(k)) = p(x(k)), = a-priori probability of d(k) 

x(k) = {x(k,b)), b refers to the codeword bits 
y(k) = {y(k,b)}, b refers to the codeword bits 

4 These definitions and the memoryless assumption, enable 
20 equations 2 to be expanded 

Pk(sls') = p(x(k) |y(k) } 

= n b p(x(k # b) ly(k,b)) 



25 5 Using 4 in equations (11) 

enables this equation to be rewritten 

Pk(s|s')= lib [ (2n) in a)' 1 exp(DX(k,b) ) 
- Pk(s' Is) 

30 6 MX decision metrics are 

from 6 in equations (11) 
DX = DX(s|s' ) 

= Z b DX(k,b) 

= Zb Re[y(k / b)x*(k,b)]/a 2 -|x(k,b) 1 2 /2a 2 +£(d(k) ) 
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= DX(s' |s) 



7 Log equations for £ k (s | s' ) =£ k (s' | s) are the log of 5 
using 6 

5 px(sls') = DX(sls') 

= DX(s' |s) 
= £k(s' |s) 

10 probabilities for each bit p (x (k,b) I y (k,b) ) . Step 5 introduces 
the standard turbo code assumption that the channel is Gaussian 
and uses BPSK (Binary phase shift keying) symbols which means 
d(k)=+/-l identical to the starting assumptions for. equations 
(11) , with a equal to the one sigma Gaussian noise along the 

15 inphase and quadrature axes. 

Step 6 generalizes the MX decisioning metric DX in 6 in 
equations (11) for p (x | y) =p (x | y) , to DX(k,b) for 
p(x(k,b) |y(k,b) )=f (x(k,b) |y(k,b) ) , and to DX (s | s' ) =DX (s' I s) equal 

20 to the sum of the DX(k,b) over all s->s' and s'->s transitions 
respectively, which is the sum over all bits {b} for clock k 
equal to codeword k. Step 7 takes the log of 5 and deletes the 
additive constants to give the log equations for the state 
transition probabilities £ k (s | s' ) =£ k (s' I s) as linear sums of the 

25 DX(s|s' ) ,DX(s' |s) and the log of the a-priori data probability 
£(d(k)). The p k (s | s' ) = p k (s' | s) will be used in turbo decoding 
algorithms , and in convolutional decoding algorithms when the log 
a-priori probability £(d(k)) is deleted. 

30. Log equations for a k (s), b k _i(s') are derived in equations 

(17) from equations (14), (15) respectively for a k (s), b k _i(s') 
using the definition of £ k (s|s') in 7 in equations (16). Step 1 
gives the log equation for a k (s) by taking the log of the a k (s) 
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Log equations for the a-posteriori 

metrics a k (s), b k -i(s') (17) 

1 Log, a k (s) , of a k (s) 

a k (s) » ln[ Zaii s'exp(a k -i(s' )+DX(s Is' ) ) ] 

2 Log, b k -i(s'), of b H (s') 
bk-iO'J-lnl Zaii 3 exp (b k (s) +DX (s' Is))] 



equation in 5 in equations (14) and using the definition of 
. £k(s|s') in 7 in equations (16). Step 2 takes the log of the 
equation for b k -i(s') in 3 in equations (15) to derive the log 
15 equation for b k -i(s') and uses the definition for £ k (s|s') in 7 in 
equations (16) . 

The new MAP equations for the log likelihood ratio 
L(d(k)|y)) are derived in equations (18). Step 1 is the definiton 

20 from references [l] / [2]. Step 2 replaces p(d(k)) with the 
equivalent sum of the probabilities that the transition from 
S(k-l)=s' to S(k)=s occurs and which are the new probabilities 
p(s,s'|y) over these transitions. Step 3 substitutes the log 
of the recursive estimators a k _i (s' ) ,b k (s) , from 1,2 in 

25 equations (17) and the £ k (s|s') from 7 in equations (16). Step 4 



The new MAP equations (18) 

1 Definition 

30 L(d(k))|y) - ln[p(d(k)-+l|y) ] 

. -ln[p(d(Jc)— l|y) ] 

2 Probability of p(d(k)) is the sum of the probabilities 
that the state S(k-l)=s' transitions to S(k)=s 
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L(d(k))|y) = ln[ 2 (s ,s'id(k)= + i) P(s,s' I y) ] 
-ln[ E (s ,s'ici(k)=-i) p(s,s'|y) ] 



3 The new MAP equation is obtained by substituting the 
5 a k -i(s' ) ,b k (s) , Ek(sl-s') 

L(d(k))|y) = ln[ Z<.,».|d(w-fi> P(s,s'|y)l 
-ln[ E (s , s -ici(k)=-i) p(s,s'|y) ] 

= ln[Z (S(S .| d ( k) „ + i) exptak-xts' )+DX(s|s' )+b k (s) ) ] 
10 -ln[Z( S , 8 ., d(k )- 1 , exp(a k -i(s')+'DX(s|s')+b k (s) )] 

3 Hard decisioning rule 

d(k) = +1/-1 when L(d(k)|y) ;> 0 / < 0 

15 5 Soft decision metric = L(d(k))|y) 



gives the hard decisioning rule. Step 5 identifies L(d(k)|y) to 
20 be the soft decisioning metric, 

FIG, 1 describing a representative turbo encoding block 
diagram for . a parallel architecture and FIG. 2 describing a 
representative implementation block diagram of a turbo encoder 
25 and transmitterapply to the invention. 

j Fig. 3 describing a representative turbo decoding block 

diagram and FIG. 4 describing a representative receiver block 
diagram for a turbo decoder receiver, apply to the invention 
30 when the turbo decoding signal flow diagram in FIG. 3 implements 

the "MAP iterative algorithm in equations (9) using the likelihood 

j ■ 

ratios in equations (18) . The decisioning metric performance 

advantage of -1.7 dB in FIG. 5,6 will support a BER improvement 

in the MAP algorithm (9) , 
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Convolutional decoding starts with the assumption of a 
sequence of observed channel output symbols {y(k), k=l,2,...,N} of 
the receiver where w k" is the running index over the N 
5 • transmitted symbols. Each set y(k) of symbols at clock k 
consists of the observed uncoded and coded symbols for the 
received codeword k at clock k. These are the same starting set 
of assumptions used for turbo decoding. 

10 FIG. 7 is a representative convolutional encoder block 

diagram. Input 46 to the encoder are the user data bits {d(k)} 
for k=l,2,. . .,N. The encoder for a convolutional code uses a 
recursive systematic code RSC or a systematic code SC which means 
the first codeword bit 47 is the user data bit called systematic 

15 bit, or bits, which are uncoded. These user data bits {d(k)} 
are also handed over to the encoder 48 followed by interleaving 
49. Output bits 50 are punctured to obtain the correct code 
rate and multiplexed 51 into a continuous output bit stream 52 of 
codewords {c(k)} for each of the codeword clocks k=l,2, Each 

20 codeword c(k) 52 is a set of bits consisting of the systematic 
bits followed by the encoder and interleaver output bits 52. 

FIG. 8 is a representative convolutional decoder block 
diagram. Inputs are the detected soft output symbols 53 from 
25 the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
for the systematic bit b=l and the outputs from the interleaved 
and encoded bits. Following de-interleaving 54 the convolutional 

decoder recovers estimates {d(k)} of the user input bits {d(k)} 
30 to the convolutional encoder. 

Convolutional decoding solves the recursive equations 
derived from equations (7) by replacing the summations over all 
possible transitions with the best transition path to each of the 
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transitions with the best transition path to each of the new 
trellis states. The best transition path for convolutional . 
decoding is the best choice of s' for each forward path s'->s and 
the best choice of s for each backward path s->s' , where best is 
the maximum value of the state metric for the path transitions. 

For the forward recursion the log ML equations are derived 
in equations (19) using the redefined state path metric g k (s) 
and the state transition decisioning function DM. Step 1 is the 

Forward equations for ML convolutional decoding (19) 

1 The ML probability density has the well-kno'wn 
factorization assuming a memoryless channel 

p(y(k)|s) - Ilj-i,_,fe-iP(y(j) Isj-i ->s 3 ) 

- p(y(k) Is'^s) p(y(k-l) |s') 

2 State path metric a k (s) in log format is 

a k (s) = £{y (k) Is) 

3 Forward equations for a k (s) are derived using 2 
and the log of 1 to yield 

a k (s) > max [£(y (k-1) I s' ) + £(y (k) | s' ->s) } 
= max [Ok-i(s') + DM (sis')] 

DM (sis' ) = £(y(k) Is'-^s) ] 

= -|y(k)-x(k) | 72a 2 

factorization of the ML probability that is allowed by the 
memoryless channel assumption. Step 2 is the definition of the 
path metric a k (s) in log format which is different from its 
definition in 1 in equations (4) for MAP turbo decoding. Step 3 
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derives the forward recursive equation for a k (s) by combining the 
equations in 1 and 2 and using the definition of the ML 
decisioning metric DM=ln [p (y (k) | s' ->s) ] = p (y (k) | s' ->s) ] for the 
path s'->s for convolutional decoding. Path metrics and the 
5 corresponding data d(k) bit for each trellis state are stored in 
a state matrix. The best path corresponding to decoding state k 
is used to select the best data d(k-D) bit decision at the state 
k-D of this path stored in the state matrix, where D is a delay 
in the data bit decisioning that is required for reliable 
10 decoding. 

For the backward recursion the log ML equations are derived 
in equations (20) using the state path metric Q k (s) in 2 in 
equations (7) , and the state transition probability )k(s,s') and 
decisioning metric DM(s|s') from 4,5,6 in equations (6). Step 1 

15 

Backward equations for ML convolutional decoding (20) 

1 State path metric |3k-i(s') in log format is equal 
to the value 1 in equation (5) 

20 &-i(s') = ln[p(y(j>k-l),s')] 

- P(y(j>k-i) is'") ] 

2 Backward equations for gk-i(s') are derived using 1 
and the 2,3 in equations (5) to yield 

25 fik-i(s') « max [£(y(j>k) |s) + E (s, y (k) |s' ) ] 

s 

= max [J3 k (s) + DM(s|s' ) ] 

s 

DM(s'ls) = -|y(k)-x(k) | 2 /2a 2 



30 is the definition of fik-i(s') in 1 in equations (5). Step 2 
modifies the derivation of J3 k -i(s') in equations (5) and the final 
equation for J3 k -i(s') in 2 in equations (7) to derive the fik-i(s') 
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for the backward convolutional decoding, with the modifications 
being 1) setting the a-priori probability £(d(k)=0 since there 
is no a-priori probability available, and 2) replacing the 
summation over all s with the maximum with respect to s of [j3 k (s) 
5 + DM (s|s f )]. Path metrics and the corresponding data d(k) bit for 
each trellis state are stored in a state matrix. The best path 
corresponding to decoding state k is used to select the best data 
d(k+D) bit decision at the state k+D of this path stored in the 
state matrix, where D is a delay in the data bit decisioning 
10 that is required for reliable decoding. 

The new convolutional decoding equations (21) for forward 
and backward recursions are modifications of the previously 
derived MAP equations for a k (s) in equations (14), b k -i(s') in 

15 equations (15), DX (s | s' ) =DX (s' | s) in equations (16), and the 
final equations for a k (s), b k -i(s') in 1,2 in equations (17). 
Modifications consist of 1) setting j>(d(k))=0 since there is no 
a-priori information on p(d(k)), and 2) replacing the summation 
over all s',s with the maximum of [a k -i (s f ) +DX (sis') ] , 

20 [b k (s)+DX(s' |s) ] respectively with respect to the path transition 
s' ->s, s->s' respectively. 

The new a-posteriori convolutional decoding 

equations (21) 

25 

1 Definition of a k (s) from 1 in equations (14) 
a k (s) = £(s|y(j<k) 

2 Forward recursion for a k (s) can be derived by 
30 modifying the derivation of a k (s) for the MAP 

turbo decoding to yield 

a k (s) = max [a k -!(s' )+ DX(s|s')] 

DX(s|s')] = Re[y(k)x*(k)]/a 2 -|x(k) | 2 /2a 2 +£(d(k)) 
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3 Definition of b k -i(s') from 1 in equations (15) 
bk-i(s') = p(s' |y(j>k-l)) 

Backward recursion for b k _i(s') can be derived by 
modifying the derivation of b k -i(s') for the MAP 
turbo decoding to yield 

b k -!(s') = max[b k (s) + DX(s'ls)"] 

s 

DX(s' Is)] = Re[y(k)x*(k)]/a 2 -|x(k) 1 2 /2a 2 +£(d (k) ) 

Step 1 for the new forward recursion uses the same 
definition of a k (s) for the MAP turbo decoding in 1 in equations 

15 (14) . . Step 2 then follows the steps in equations (14) , (16) 
leading to the equations 1 in equations (17) for a k (s) for the 
MAP turbo decoding, upon replacing the summation over s' with the 
maximization with respect to s' similar to the derivation of the 
forward recursion equations for a k (s) in (19). Path metrics and 

20 the corresponding data d(k) bit for each trellis state are stored 
in a state matrix. The best path corresponding to decoding state 
k is used to select the best data d(k-D) bit decision at the 
state k-D of this path stored in the state matrix, where D is a 
delay in the data bit decisioning that is required for reliable 

25 decoding. 

Step 3 for the new backward recursion uses the same 
definition of b k -i(s') for the MAP turbo decoding in 1 in 
equations (15) . Step 4 then follows the steps in equations 
30 (15), (16) leading to the equations 2 in equations (17) for b k - 
i(s') for the MAP turbo decoding, upon replacing the summation 
over s with the maximization with respect to s similar to the 
derivation of the backward recursion equations for J3 k -i(s') in 
(20). Path metrics and the corresponding data d(k) bit for each 
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trellis state are stored in a state matrix. The best path 
corresponding to decoding state k is used to select the best data 
d(k+D) bit decision at the state k+D of this path stored in the 
state matrix, where D is a delay in the data bit decisioning 
5 that is required for reliable decoding. 

Preferred embodiments in the previous description of the 
probabilities, decisioning metrics, algorithms, and 
implementations, are provided to enable any person skilled in 

10 the art to make or use the present invention. The various 
modifications to these embodiments will be readily apparent to 
those skilled in the art, and the generic principles defined 
herein may be applied to other embodiments without the use of the 
inventive faculty. Thus, the present invention is not intended 

15 to be limited to the embodiments shown herein but is intended to 
be accorded the wider scope consistent with the principles and 
novel features disclosed herein. 

It should be obvious to anyone skilled in the 
20 communications art that these example probabilities, decisioning 
metrics, algorithms, and implementations, define the 

fundamental architecture and signal processing relevant to this 
invention disclosure and it is obvious that this example is 
representative of the other possible signal processing 
25 approaches. 

For cellular applications the receiver description in FIG. 
4 includes the t new turbo decoding and the new convolutional 
decoding and describes the corresponding receiving signal 
30 processing for the cellular hub and user. 

For optical communications applications the microwave 
processing at the front end of both the transmitter and the 
receiver is replaced by the optical processing which performs the 
35 complex modulation for the optical laser transmission in the 
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transmitter and which performs the optical laser receiving 
function of the microwave processing to recover the complex 
baseband received signal. 
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